Analytic Investigations of Random Search Strategies for Parameter Optimization 
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Several standard processes for searching minima of potential functions, such as thermodynamical 
strategies (simulated annealing) and biologically motivated selfreproduction strategies, are reduced 
to Schrodinger problems. The properties of the landscape are encoded in the spectrum of the 
Hamiltonian. We investigate this relation between landscape and spectrum by means of topological 
methods which lead to a possible classification of landscapes in the framework of the operator theory. 
The influence of the dimension d of the search space is discussed. 

The connection between thermodynamical strategies and biologically motivated selfreproduction 
strategies is analyzed and interpreted in the above context. Mixing of both strategies is introduced 
as a new powerful tool of optimization. 
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I. INTRODUCTION 



The optimization problem appears in several fields of 
physics and mathematics. It is known from mathematics 
that every local minimum of a convex function denned 
over a convex set is also the global minimum of the func- 
tion. But the main problem is to find this optimum. 
From the physical point of view every dynamical process 
can be considered in terms of finding the optimum of the 
action functional. The best example is the trajectory of 
the free point mass in mechanics which follows the short- 
est way between two points. 

Let us assume one has successfully set up a mathemat- 
ical model for the optimization problem under consider- 
ation in the form 



U(xi,X2, ■ ■ ■ ,x d ) 



Min 



(1) 



where U is a scalar potential function (fitness func- 
tion) denned over a d-dimensional vector space X — 
C{x\, . . . , Xd}- Let x^ ' be the absolute Minimum of 
U which is the search target. Problems of this type 
are called parameter optimization. Typically the search 
space is high-dimensional (d^$> 1). 

The idea of evolution is the consideration of an ensem- 
ble of searchers which move through the search space. As 
a illustrative example we consider the relation between 
the equation of motion in mechanics, obtained by vari- 
ation of the action functional S to get a trajectory of 
minimal action, and the introduction of the probability 
distribution for all possible trajectories by a functional 
integral. Because of the weight factor exp(— S/K) for ev- 
ery trajectory, the trajectory of minimal action has the 
highest probability. The equation of the probability dis- 
tribution deduced from the functional integral is the dif- 
fusion equation for a free classical particle. The same idea 
is behind the attempt to describe optimization processes 
with the help of dynamical processes. 



We will be concerned with the time evolution of an 
ensemble of searchers defined by a density P(x, i). The 
search process defines a dynamics 



P(x, t + At) = T[P(x, t); At] 



(2) 



with continuous or discrete time steps. An optimization 
dynamics T is considered as successful, if any (or nearly 
any) initial density P(x, 0) converges to a target density 
lim P(x, t) which is concentrated around the minimum 

T — >0O 

of U(x). We restrict ourselves here to the case where 
T is given as a second order partial differential equa- 
tion. Among the most successful strategies are the class 
of thermodynamic oriented and the class of biolog- 
ical oriented strategies |@-§|). Our aim is to compare on 
the basis of PDE-models thermodynamical and biologi- 
cally motivated strategies by reducing both to equivalent 
eigenvalue problems. Further we introduce a model for 
mixed strategies and investigate their prospective power 

ti- 



ll. THERMODYNAMICAL STRATEGIES 

At first we want to investigate the simplest case of an 
evolutionary dynamics known in the literature as "simu- 
lated annealing" . The analogy between equilibrium sta- 
tistical mechanics and the Metropolis algorithm (!(]] was 
first discussed by Kirkpatrick et al. in [pj| . There, 
an ensemble of searchers determined by the distribution 
P(x, t) move through the search space. In the following 
we consider only the case of a fixed temperature. Then 
the dynamics is given by the Fokker-Planck equation 



at 



P(x, t) = V\D • [VP + fJVUP] = DAP + DV(PPVU) 

(3) 



1 



with the "diffusion" constant D, the reciprocal temper- 
ature and the state vector x. The stationary distri- 
bution P ~ exp(— 0U(x)) is equal to the extremum of 
functional © gj. 

For the case = the complete analytical solution is 
known and may be expressed by the well-known heat ker- 
nel or Green's function, respectively. The corresponding 
dynamics is a simulated annealing at an infinite temper- 
ature which describes the diffusion process. In this case 
the optimum of the potential will be found by a random 
walk, because the diffusion is not sensitive to the poten- 
tial. The average time which the process requires to move 
from the initial state x(0) to the optimum x^ ' is given 
by 



— <(f(0)-f (0) ) 2 > 



(4) 



We note that in several cases a generalization from the 
number D — const, to the case where D is a symmetri- 
cal matrix is possible [Q . Further solvable cases can be 
extracted from the ansatz 



P{x, t) = exp 



0U(x) 



y{x, t) 



(5) 



which after separation of the time and space variables 
leads to the eigenvalue equation 

- H)tp(g) = DA<ip(x) + (e - V{x))ip{x) = (6) 
y{x,t) = exp(-et)^(£) 

with eigenvalue e and potential 

2 
V(x) = -^DVU ■ VU ~ 2 DAU ■ ( 7 ) 

This equation is the well-known stationary Schrodinger 
equation from quantum mechanics. Under the consid- 
eration of a discrete spectrum this leads to the general 
solution 



P(x, t) = exp 



2J Ciipi(x) exp(-ejt) 



(8) 



To discuss more properties of equation (Q), one has to 
introduce the concept of the Liapunov functional Jll| de- 
fined by the formula: 



d . S . . 
— y{x,t) = -—£{y,Vy) 



In the case of equation 

d_ 

lit 

we obtain 



y{x,t) = DAy{x,t) - V(x))y(x,t) 



£(y,Vy) = / L{y,Vy)dvol{X) 



(9) 



(10) 



(11) 



x 

L{y,Vy) = ^y) 2 + l -Vy 2 



For the original equation (||), the construction of such 
functional is impossible. 

We remark that the main difference between 
Schrodinger equation and thermodynamical strategies is 
given by the time-dependent factor in the solution. In 
quantum mechanics this set of factors exp(iei) forms a 
complete basis in the Hilbert space of functions over t 
but in the solution of (^) this is not the case. 

Because of the existence of an equilibrium distribution 
the first eigenvalue eo vanishes and the solution is given 
by 



P(x,t) = const, exp [—0U(x)] 



(12) 



That means that the equilibrium distribution is located 
around the optimum since the exponential exp(— U(x)) is 
a monotonous function and the optimum is unchanged. 
In the limit t — > oo the distribution P(x, t) converges to 
the equilibrium distribution and the strategy successfully 
terminates at the optimum. But this convergence is de- 
pendent on the positiveness of the operator H defined in 
@ . Usually the Laplace operator is strictly negative def- 
inite with respect to a scalar product in the Hilbert space 
of the square integrable functions (L 2 -space). Therefore 
the potential alone determines the definiteness of the op- 
erator. We thus obtain 

< J y(x)V(x)y(x)dvol(X) 
x 



A sufficient condition for that is 



^{VUf > AU 



(13) 



which means, that the curvature of the landscape rep- 
resented by AU must be smaller than the square of the 
gradient. Depending on the potential it thus is possible 
to fix a subset of X on which the operator H is positive 
definite. 

Now we approximate the fitness function U (x) by a 
Taylor expansion around the optimum including the sec- 
ond order. Because the first derivative vanishes one ob- 
tains the expression 



1 " 



U(x) = Vmin + - > . CLi(x 



2 ^ 

i=l 



4 0) ) 5 



(14) 



For at > we get the simple harmonic oscillator which 
is solved by separation of variables. The eigenfunctions 
are products of Hcrmitian polynomials with respect to 
the dimension of the search space. Apart from a con- 
stant the same result is obtained in the case Oj < 0. A 
collection of formulas can be found in appendix A. 

The approximation of the general solution (||) for large 
times leads to 



2 



P(x, t) = c exp(— 0U(x)) + cie £l * exp 



-U{x) 



(15) 



Because of the condition e 2 > ei, the time r = 1/ei can 
be interpreted as relaxation time, i.e. the time for the last 
jump to the optimum. Even more interesting than the 
consideration of the time is the calculation of velocities. 
One can define two possible velocities. A first velocity 

on the fitness landscape and a second one v k 2 ^ in < U > (t) 
the fc-th direction of the search space. The measure of 
the velocities is given by the time-like change of the ex- 
pectation values of the vector x k or the_potential U(x), 



:_pc 



respectively. With respect to equation (H) we obtain 



v {1) = — - < U >= D/3 < VU ■ VU > -D < AU > 
dt 



and 



,( 2 ) 



— <x k >= D(3 < Vx fe ■ VU > 
dt 



(16) 



(17) 



The velocity depends on the curvature and the gradi- 
ent. So we can deduce a sufficient condition for a positive 
velocity 



/3(VC/) 2 > AU 



(18) 



which is up to a factor the same as condition (|l^). For 
the quadratic potential (ph one obtains 



^ (0) |> 



Vt 



(19) 



This is a restriction to a subset of X. 

In this case it is also possible to explicitly calculate the 
velocities for aw > 



(i) 2 02 < *\ 

v y ' = - — e 2 exp(-e 2 i) 



.,(2) 



Cl 



(3a k c 



ei exp(-eii) 



(20) 
(21) 



It is interesting to note that only the first two eigenvalues 
are important for the velocities and that both velocities 
vanish in the limit t — > 00. Besides, the first velocity 



is independent of the parameter a% except for special 



initial conditions where the factor c k depends on the pa- 
rameter cii. The other case < is similar and can be 
found in appendix A. 



III. FISHER-EIGEN STRATEGIES 

In principle, the biologically motivated strategy is dif- 
ferent from the thermodynamical strategy. Whereas in 



the thermodynamical strategy the population size re- 
mains constant, it is changed with respect to the funda- 
mental processes reproduction and selection in the case of 
biologically motivated strategies, but is kept unchanged 
on average. The simplest model with a similar behaviour 
is the Fisher-Eigen equation given by 

^-P(x, t) = [<U> -U(x)]P(x, t) + DAP(x, t) (22) 
at 



J U(x)P(x, t)dx 
/ P(x, t)dx 



In this case one can also form a Liapunov functional 
which satisfies the equation ([)]) similar to the thermo- 
dynamical strategy. One obtains the positive functional 



D 



1 



C = ^(VPY - o(< U > -U)P Z dvol(X) (23) 



x 



which also has the stationary distribution as an ex- 
tremum. 

By using the ansatz 



P(x, t) = exp 



<U> (t')dt' 



y(x,t) (24) 



and the separating time and space variables, the dynam- 
ics reduces to the stationary Schrodinger equation 

[d - H)i>i(x) = DA^{x) + ^ - U(x)]iPi(x) = (25) 

where Q are the eigenvalues and ipi (x) are the eigenfunc- 
tions. This leads to the complete solution 



y(x, t) 



tpi(x) 



(26) 



The difference to the thermodynamical strategy is given 
by the fact that the eigenvalue eo in the case of the Fisher- 
Eigen strategy is a non zero value, i.e. the relaxation time 
is modified and one obtains 



to 



1 



d - e 



(27) 



For the harmonic potential (|lj) the problem is exactly 
solvable for any dimension d and the solution is very sim- 
ilar to the thermodynamical strategy for a. L > 0. In the 
other case on < we obtain a different problem known 
from scattering theory. If the search space is unbound 
the spectrum of the operator H is continuous. From the 
physical point of view we are interested in positive val- 
ues of the potential or fitness function (|lj) , respectively. 
This leads to a compact search space gi ven by the i nter- 
val [—6,6] in each direction with 6 = yj2U m i n /\ai\. We 
now have to introduce boundary conditions. The most 
natural choice is to let the solution vanish on the bound- 
ary. As a result an additional restriction appears and the 
spectrum of the operator H is now discrete. A collection 



3 



of formulas connected to both eigenvalue problems can 
be found in appendix B. 

The next step is the calculation of the velocities defined 
in the previous section. With respect to the Fisher-Eigen 
equation ( p2| ) one obtains 

= < U 2 > - < U > 2 -D< AU > (28) 
v {2) = < x k U > - < x k >< U > . (29) 

For the case of a quadratic potential all velocities can be 
calculated from the solution and with a,i > the follow- 
ing expansion is possible: 



= ADe 



o 



0(e 



(-(<* 



,( 2 ) 



a, co 



-eo)t)) 



0(e 



(-(es-£0)*)l 



(30) 
(31) 



These velocities are very similar to the velocities of the 
thermodynamical strategy. So it is very difficult to decide 
whether or not the thermodynamical strategy is faster 
than the biologically motivated one or vice versa. This 
decision depends on the particular circumstances. The 
thermodynamical strategy is faster than the biologically 
motivated one in a landscape with a slight curvature 
and widely extended hills whereas the biological strategy 
needs a landscape with a high curvature and more local- 
ized hills to be faster than the thermodynamical strategy. 

We note the interesting fact, that there exist special 
tunnel effects connected with minima of equal depth and 
shape. The corresponding spectrum of the Hamiltonian 
shows degenerated eigenvalues. Then under the condi- 
tion of overlapping distributions located in different min- 
ima an tunnelling with high probability between these 
minima is possible (see Fig. [j], dotted line). For the 
corresponding Boltzmann strategy the transformed po- 
tential does not admit this tunnelling effect (Fig. [l], solid 
line). 




FIG. 1. The double well problem for Fisher-Eigen and 
Boltzmann 



IV. MIXED BOLTZMANN-DARWIN 
STRATEGIES 

The dynamic equations defining Boltzmann-type 
search and Fisher-Eigen type search contain a common 
term DAP. Since both types of strategies have definite 
advantages and disadvantages it seems desirable to mix 
them. We defined the dynamics of a mixed strategy by 



= DAP{x,t) 
+ 7[< U > - 



+ (3DV{PVU) 
U(x)]P(x,t) 



(32) 
(33) 



For 7 = this dynamics reduces to a pure Boltzmann 
strategy and for (3 = we obtain a Fisher-Eigen strat- 
egy. The mixed case may be treated by means of the 
ansatz 



P{x, t) = exp 



7 / <U>dt' - \l3U{x 



y{S,t) (34) 



which leads to the explicit solution in the cigenfunctions 
of the problem 







E{x) =~{U - 



DA^(x) + 
D/3 



AU- 



-E{x)]^{x 
Dp 2 



(35) 



(W) • (VtO 



2 4 

For (3 = and 7 = 1 we end up with the case of Fisher- 
Eigen strategies and for 7 = , (3 > the Boltzmann 
dynamics is obtained. In this respect the mixed strategy 
is indeed a generalization of both cases (see Fig. 0) . 




FIG. 2. The parameter dependence of the mixed strategy 

The linearity of the differential equation leads to sim- 
ple relations between the solutions and velocities. For 
instance the velocities for the thermodynamical and the 
biological strategy can be added with respect to the con- 
stant 7 to get the velocities of the mixed strategy. For 
the solution of the problem one simply takes the solution 
of the thermodynamical strategy (Al) and redefines the 
coordinate by 
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So the mixed strategy combines the advantages of both 
strategies if one uses a criterion to choose the coefficients 
7 and (3. The dependence on the 3 optimization parame- 
ters D, (3 and 7 is a rather simple one. For a given D, the 
best strategy is evidently an increase of the (3- value, since 
the 7-dependence is weak. However, if the "friction" (3D 
is fixed by the conditions, the maximization of 7//? leads 
to the smallest relaxation time. In other words, if the 
loss (3D is fixed, maximal 7 (i.e. most competition) and 
minimal (3 (i.e. large temperature) is the best choice for 
a fast search of the minimum. In general the optimal 
search requires (3 > and 7 > 0. With other words, 
adding some amount of the "complementary" strategy 
is in most cases to be recommended. This was already 
found empirically in a earlier work . 

V. GLOBAL PROPERTIES OF STRATEGIES 

The study of the problem given by the potential Ji4| ) 
is the same as the study of the local properties of the 
landscape. It is known from the Lemma of Morse, that 
there is a coordinate system so that every function with 
non-degenerate critical points in the neighborhood U p of 
one critical point p can be expressed as 

/ = f(p) - {yif - • ■ ■ - M 2 + {vx+if + ■■■ + (y d ) 2 

with (yi, . . . , yd) as coordinate system. The number A is 
the index of the critical point. Now we use the compact 
space X U {00} rather than X = M d which in contrast 
to 1R is homeomorphic to S d , the d-dimensional sphere. 
Now every function over S is non-degenerate and we ob- 
tain for the number C\ of critical points with index A the 
Morse inequalities Q 

1<C l<C d 0<C L (36) 

i + (-i) d = ]T(-im ( 3? ) 

A 

with 1 = 1, . . . d — 1. So we find that in the case of 
many maxima and minima the number of saddle points 
increases (T^] . This is a global statement which only de- 
pends on the topology of the sphere S d . 

In the case of a compact, simple-connected subset of 
lR d one obtains a similar result because the boundary 
of this subset is homeomorphic to a d — 1 dimensional 
sphere and the Morse inequalities can be used again. If 
this subset has no boundary then we obtain 

I = ]T(-I) A C A (38) 

A 

and the result of |l5| can be deduced again. The treat- 
ment of constraints in the optimization problem is con- 
nected with the occurrence of holes in the space. This 



leads to a correction of the formulas (|37]) or ([58]), re- 
spectively. The number of saddle points increases with 
respect to the number of holes. 

Next we want to study the influence of the landscape 
on the solutions in terms of the dynamics, which in our 
case is restricted to the influence of the potential or fit- 
ness function, respectively. The general form of this dy- 
namics is given by 

J^POM) = -HP(x,t) (39) 
with the selfadjoint Operator 

H B = -DV • (V + [3VU) Boltzmann (40) 
Hfe = - < U > +U - DA Fisher-Eigen . (41) 

This operator equation has the formal solution 

P(x, t) = exp(-tH)P(x, 0) (42) 

acting on the initial condition. With the help of (p4|), the 
operator for the Fisher-Eigen strategy can be reduced to 
H = U — DA. Then both operators are in the same class 
known as generalized Laplacian. The representation of 
this class from a unified point of view is possible. To this 
end we introduce the Dirac operator as a first order differ- 
ential operator and regard the generalized Laplacian H 
as the square of the Dirac operator. It was shown in |l6| ] 
that every generalized Laplacian can be represented by 
the square of a Dirac operator with respect to a suitable 
Clifford multiplication. For the two cases one obtains 

D B = i^{d^ + d^U) Boltzmann (43) 
Dfe = 7 M (d M + iA„{x)) Fisher-Eigen (44) 

where 7^ are the Dirac matrices (fi — I, . . . d) and A^(x) 
is a locally defined vector field with [7^, r y^]d^A l ,(x) = 
—iU(x). Together with the expression 

D -(rS) (45) 

for every Dirac operator £>, one can simple calculate the 
squares of the Dirac operators to establish 

with the adjoint operator (j)* . This means that both prob- 
lems can be described by the motion of a fermion in a 
field VU or iA(x), respectively. The equilibrium state 
(or stationary state) is given by the kernel of the oper- 
ator H which is the direct sum ker H = ker ^ © ker (j)* . 
If the dimension d is even, which is always true for the 
high-dimensional case, this splitting can be introduced by 
the product of all 7-matrices usually denoted by 7 s . Be- 
cause of the compactness of the underlying space S d , the 
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kernel of H is finite-dimensional and the spectrum is dis- 
crete. We note, that the spectrum of both, (/)(/)* and (/)*(/), 
is equal up to the kernel. So the interesting information 
about the problem is located in the asymmetric splitting 
of the kernel ker H. The physical interpretation is given 
by an asymmetric ground state of the problem which is 
only connected to the geometry of the landscape. In more 
mathematical terms both Dirac operators are described 
as covariant derivatives with a suitable connection. To- 
gether with the fiber bundle theory [|l7| and the classifi- 
cation given by the K-theory [jl8j one obtains a possible 
classification of the fitness landscapes in dependence of 
convergence velocities given by the periodicity of the real 
K-theory with period 8. Each of these 8 classes describes 
a splitting of the kernel ker H and leads to a different 
velocity. A complete description of this problem will be 
published later on. 



VI. CONCLUSIONS 

In physics the most classical dynamical processes fol- 
low the principle of minimization of a physical quantity 
which often leads to an extremum of the action func- 
tional. This problem frequently has a finite number of 



solutions given by the solutions of a differential equation 
also known as the equation of motion. Investigating this 
fact in relation to optimization processes, one obtains in 
the simplest case the thermodynamical and the biologi- 
cal strategy. The description is given by the distribution 
of the searcher and a dynamics of the distribution con- 
verging to an equilibrium distribution located around the 
optimum of the optimization problem. With the help of 
the kinetics and the eigenfunction expansion, we investi- 
gated both strategies in view of the convergence velocity. 
In principle both strategies are equal because one ob- 
tains a stationary Schrodingcr equation. But, the main 
difference is the transformation of the fitness function 
(or potential) from U(x) to V(x) (see (fjj)) in the case 
of the thermodynamical strategy. The difference of both 
strategies leads to the idea of adding a small amount of 
the "complementary" strategy in order to hope for an im- 
provement. The difference in the velocity on the one hand 
and the similarity in the equation on the other look like a 
unified treatment of both strategies under consideration. 
This is represented in the last section in the formalism 
of fiber bundles and heat kernels to get the interesting 
result, that up to local coordinate transformations the 
strategies are split into 8 different classes. 



APPENDIX: A - THERMODYNAMICAL STRATEGY 

For the case of quadratic potentials ( |l4| ) the problem (||) may be solved explicitly. We get the eigenvalues 

£ni...n d = U min + ^ a^D [n l + Ui = 0, 1, 2, . . . 

and the eigenfunctions 

i>n 1 ...n d (xi, ■■■ 1 X d ) = \\_i> ni {Xi) 
WnA x i) = ex P I ~~ X i 

which lead to the solution 




P(x, t)= J2 « II [ e M~ti)H nk (&)] exp(-^t) 



(Al) 



i=m + ...+nd k=l 



with £fc = Xk y (ia^jl. Next we have to fix initial conditions for this problem. At first one starts with a strong 
localized function, i.e. with a delta distribution. 



P(x,0) = l[5(x l -x\ 0) ) 



Because of the relation: 



J exp(-e)H n (()H m (0d^ = S mn J exp(-£ 2 )ff'(0^ = S mn N n = 5 mn 2 n {n\)^ 



(A2) 



G 



we obtain for the coefficients 



Cfe 



(A3) 



with k = rii + rt 2 + . . . + rid- In the case of the full symmetry a — a\ = a 2 = • • • = dd we can calculate the radial 
problem to obtain the eigenvalues 



0Dd (k + - 



e — a 

with d as the dimension of the landscape. The calculation of the velocities leads to two cases for the potential (|l4|): 
1. cti > 

2c 2 



/?ci 



e 2 exp(-e 2 i) 



(2) _ / 2 Ci 



ei exp(-eit) 

pa fe c 



2. ai < 



1 fe=0 i=l V 



n 



- (2fc + l)(2fe + 2)(2fc + 3) .11. (2fc + l) 

+ . . -k d = k 



,(2) _ 



2 1 x 



(3a k N : 



n 



k=0 



(2k + 2)(2k + 3) .11. (2fc+l) 

fel + ...fc £ £ = fe 



where 



= 2J c 2fc exp(-e 2fc i) J| 



fc=0 



#2fc»+l(&i) 

{2k + 1) 



fc 1 + ■ - ■ k d = fc 



is the normalization factor and 6^ = y^2U m /ai is the interval length. 



(A4) 
(A5) 



(A6) 
(A7) 



APPENDIX: B - BIOLOGICAL STRATEGY 

For a harmonic potential ( |l4| ) the problem (^) is exactly solvable for any dimension d. We get the eigenvalues 

£m...n d = U min + D (ni + m = 0, 1, 2, . . . 

and the eigenfunctions 

d 

ip ni ...n d (xi, ■■■>Xd) = JI^W 



^fai) = exp ( - J -^a; 2 ) iT ni 




which lead to the solution 



d r 

p(x,t)= Yl c Ii 

?'-ni + ...+n d fe=l 



exp(-e,t) 



(Bl) 
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with £ k = x k $/a k /(2D). 

We now come to the problem of the maximum, i.e. the potential ( |l4|) with a, < 0. The solution for one dimension 
(direction i) is simply obtained as 



2D 6 



(B2) 



with = A,/ (2y/Da,i) and Dk(x) as parabolic Bessel functions depending on the parameter Bi. In practice one is 
interested in positive values of the fitness function or potential which leads to a restriction of the search space X to 
the a hypercube with length bi = y / 2U m /ai in every dimension. We claim that the solution vanishes at the boundary 
of the hypercube. This restriction leads to a discrete spectrum. The zeros of the parabolic Bessel function are given 
by the solution of the equation 



PkiV Pki ~ 1 - arccoshp fc , 



a / U m +nj 



(B3) 



where the coefficients Ai can be found in the book and the zeros are defined by c = 2^/alp. For the eigenvalues 
efc in (p5|) one obtains 



E 



Urn ID 



(B4) 



The calculation of the velocities is very lengthy and one obtains 
1. ai > (minimum): 

d 



,(!) 



,(2) 



-y 



Dot 



coeoe 



' ' ' " ^' - nfe+1 ^(2^ 2 + k + \)c 2k e 2k e-^ 



I2D 3 



\ k= 

g ( _ 1)fe (2fc+l)! 



\k=0 



with 



C2fe+ie2/c+i exp(-e 2 fe+ii) 



Ni = y(-l) ki ^c 2k eM-t2kt) 



as normalization. 
2. case < (maximum) 

«« = 

(2) 
V k = 

with 



N 2 



k=0 



oo d 

e 

i=l 



it! 



r(j+j6i/g) 



• l + ...n d = 
OO 



£ e 



r(f + ibi/2) 



2r(| + z6 l /2) 



fc=i 



ra + ibi/2) 



ii())h($k)\l^ 



(B5) 
(B6) 

(B7) 



(B8) 
(B9) 



N : 



2t/ m 4/ la*; 



|a k | V 2D 

oo d 

e 



= / &yi = / 4() = / yi(a)de* 



bk = 



"A- 



i=l 



r(i + i6 fe /2) 



r(|+z6 fe /2) 



40 



(BIO) 

(Bll) 
(B12) 



8 



and functions 2/i(),y2() defined in M] page 692 as series 



yi(&)=l + b k ^+\bl--\^ + ... (B13) 
y 2 (6) =Zk + bM+(bl-f)$ + ... (B14) 



3! V 2/5! 
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